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Recently, Suyari has defined nonextensive information content measure with unique class of func- 
tions which satisfies certain set of axioms. Nonextensive entropy is then defined as the appropriate 
expectation value of nonextensive information content [H. Suyari, Phys. Rev E 65 066118 (2002)]. 
In this comment we show that the class of functions determined by Suyari's axioms is actually wider 
than the one given by Suyari and we determine the class. Particularly, an information content corre- 
sponding to Havrda-Charvat entropy satisfies Suyari's axioms and does not belong to the class given 
by Suyari but belongs to our class. Moreover, some of the conditions from Suyari's set of axioms 
are redundant, and some of them can be replaced with more intuitive weaker ones. We give a mod- 
ification of Suyari's axiomatic system with these weaker assumptions and define the corresponding 
information content measure. 



I. INTRODUCTION 



In [3] , Suyari gives a nonextensive generalization of ax- 
ioms for standard information content Nonextensive 
information content is defined as a function Iq (p) of two 
variables q £ and p G (0,1], which satisfies the fol- 
lowing axioms. 

[TO] hip) = lim /„ (p) = -k\np, k 0; 

q^l 

[Tl] Iq is differentiable with respect to p G (0, 1) and 

q e M+, 

[T2] Iq [p] is convex with respect to p S (0,1] for any 
fixed q e R+; 



[T3] there exists a function ip 



such that 



Iq (PlPz) _ Iq jpi) , Iq (^2) ^ Iq jpi) Iq (Pt) 



k 



k 



for any pi,p2 G (0,1], where ^p{q) is differentiable 
with respect to g e M+ and 

lini^^^^O, lim^(g) = v^(l) = 0, <^(g)^0(g^l) 

(2) 

For q = l axioms [Tll~[T3] reduce to axioms of standard 
information content [4] , which is given with [TO] . 
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Suyari claims that nonextensive information content 
Iq {p) obtained from the axioms [T0]~[T3] is uniquely 
determined with the function 



Iq (P) = fc • 



P 



for q =/= I, where k is a positive constant and 
(?) + 1 > for any g G M+. 



(3) 



(4) 



However, the class of functions which satisfy [T0]^[T3] 
is actually wider than the class given by Suyari. For 
example, the information content given by 



/, (p) = -fcln2 



P 



1-9 _1 



21-9 - 1' 



(5) 



clearly does not belong to the class determined by equa- 
tion dS]). On the other hand, ^ obviously satisfies 
[T1]~[T3]. Moreover, if we introduce 7p(g) = p^^"^ — 1 
and S(q) = 2^~'^ — 1, and divide the numerator and de- 
nominator with 1 — g, we get 



Iq (p) = -k\np ■ 



ln(l+(5(g))i/^(g) 
ln(l + 7p(g))i/7p(9)- 



(6) 



Now, [TO] straightforwardly follows if we take the limit, 
noting that ^p{q) and ^(q) — > as g — 1 and keeping 
in mind that lim (1-1-0;)° = e. In section HIl we determine 

a— fO 

the class to which both information contents, ^ and (O, 
belong. After that, in section Hill we show that averag- 
ing of information content ^ yields the Havrda-Charvat 
entropy 
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In section IIVI we consider the redundancy of some 
conditions from [T0]'^[T3]. Particularly, the conditions 
lim ip{q)^tp (1) 0, and ^{q) {q ^ 1) from [T3] 

are redundant, since they follow from [T0]^[T2]. More- 
over, the condition lim ^^^^^ Q from [TSl is introduced 

to ensure that L'Hospital's rule can be applied on (|3]) 
to prove that [TO] holds. However, this is unnecessary, 
since the satisfaction of [TO] can be shown without the 
use of L'Hospital's rule in elementary way using equal- 
ity lim (1 -I- a)~ — e, as we have shown in the previous 

a— >0 

paragraph. In addition, in section ITVl we give an alterna- 
tive proof for the information content without use of the 
differentiability condition from [Tl] so that the differen- 
tiability condition can be weakened to continuity. 



II. NEW CLASS OF INFORMATION CONTEXT 
FUNCTIONS - CORRECTION TO SUYARI'S 
PROOF 

Theorem 1 Let Iq{p) be a function of two variables 
q e M+ and p e (0, 1], which satisfies axioms [T0]--[T3]. 
Then, Iq{p) is uniquely determined with 



q; the rigorous solution is 



Iqip) 



(q) 



1 



where k G and 
(a) a (g) is differentiablc with respect to any q G 

hm ^ = -1; 



(b) it holds that 



a{q) G 



q^i tp{q) 



(-00, 0] for ip{q) > 
[0, 1] for ip{q) < 0. 



(7) 

and 
(8) 

(9) 



Remark 1. Positivity of constant k directly follows 
from the convexity of Ii{p)- Positivity of k further im- 
plies nonnegativity of information content ([7|) . 

Remark 2. For the case a{q) = —(p{q) information 
content ([7]) reduces Suyari's information content ^ and 
the condition ([9]) reduces to ([4]). 

Proof. Following Suyari S] , we substitute pi ~ p and 
P2 = 1 + A in equation ([T]) and divide the equation with 
Ap. By taking the limit A ^ on both sides of the 
resulting equation and using differentiability of Iq {p) , we 
obtain 



(10) 



dlqip) _ l3{q) k + ip{q)Igip) 
dp k p ' 

where the function l3(q) is defined with f3(q) = 
lim M^. This can be solved analytically for every 



Iq (P) = k 



{C{q)p 



(11) 



where C{q) and /3{q) are functions of q [5]. If we introduce 



K{q) = C{q)^ 



and a{q) 



expression ([TT|) becomes 
k 



For pi = p2 = I, [T3] reduces to 
with 



= 0, 



/,(1) 



{K{q)-l). 



(12) 



(13) 



(14) 



(15) 



Equality (IT4|) can be satisfied if and only if (1) = 
or Iq{l) — The former case is not allowed since 

it is inconsistent with [TO]. Accordingly, Iq{l) — 0, or 
equivalently K{q) = 1, and (IT^ reduces to ([T]). 

We will now prove the property (a). Differentiability 
of a{q) follows from ([T]), since Iq{p) and Lp{q) are differen- 
tiablc with respect to q. Moreover, by use of [T3] we have 
lim aiq) = 0, and which implies that there exists a > 

such that a{q) ^0 for g G (1 — a, 1 + a) \ {1}. Otherwise 
there exists a sequence qi,g2,--- converging to 1, such 
that a{qi) = and I{qi) = 0. This contradicts [TO] since 
I{qi) as i cxD. Let us introduce 7(5) = p"''') — 1. 
Using 7(5) — when q 1 and {1 + t)' — s- e when 
i — ?• 0, we have 



lim Iq (p) 

q^l 



lim 



k 



k ■ lim 

q^i ip{q) 



g^iipiq) V 
a{q) p^ii) - 1 



(9) 



1 



a{q) 



= k ■ lim 



a{q) 



\np 



i^^fiq) ln(l-f7(g))^ 
a{q) 



fc In p • lim 



(16) 

fc Inp and property 



9^1 tp{q) 

According to [TO] , we have lirn Iq 
(a) follows. 

Property (b) can be proven by taking the second 
derivative of Iq (p) with respect to p, which should be 
nonnegative for any fixed q G M^, since Iq{p) is convex 
by [T2]. Thus, we can derive a constraint 



(aiq) - 1) > 



(17) 
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for any q G M^. Since k is positive, the constraint p7)) 
is satisfied if 

r(-^,0]U[l,H for^(g)>0 
"^'^^n [0,1] for^(,)<0. ^''^ 

We will now prove that a{q) ^ [l,oo) for ip{q) > 0, by 
contradiction. 

Recall that (p{q) ^0 for q 7^ 1, by [T3] and according 
to the intermediate value theorem, (p{q) does not change 
sign on (0, 1) nor on (1, 00]. Let 



^p{q) > 0, for all <7 > 1, 



(19) 



and let a{q) G [1, 00) for some q > 1 (the case < q < 1 
can be considered analog). 

According to ([5]) , for arbitrary small e > there exists 
S > such that \a{q')\ < e for q' S (1,1 + 5). Hence, 
a{q') < e and a{q) > 1 for some q,q' > 1. According 
to the intermediate value theorem, if /i G (£,1), then 
a{q") = fi for some q" > 1. If we combine the condition 
a{q") G (e, 1) for some q" > 1, with condition ([T^. we 
get 



ip{q") < 0, for some q" > 1. 



(20) 



According to the intermediate theorem, and ^IU\\ 

imply that there exists q' > 1 such that (p{q') — for 
some q' > 1. This contradicts the condition ip{q) ^ 
(g 7^ 1) from [T3] and proves property (b). 



III. HAVRDA-CHARVAT ENTROPY AS 
EXPECTED INFORMATION CONTENT 

Nonextensive entropy of distribution p, Sq (p), is de- 
fined as the appropriate expectation value of Iq (p), 



Sq ip) ^ Eq^p [Iq {p)] 



(21) 



Similarly, the KuUback-Leibler (KL) divergence between 
distributions p"^ and p^ is defined by means of the infor- 
mation contents difference, 

Kq {p^ Wp"")^ Eq^pA [Iq (p^) - /, (p^)] . (22) 

According to Suyari, the expectation should be cho- 
sen so that the KL divergence is nonnegative [3|. One 
possible choice is generalized q-expectation 



w 



(23) 



i=l 



By use of Jensen's inequality following Suyari's proof 
([3|), it can be straightforwardly shown that generalized 
expectations (j23p can be combined with information con- 
tent (O leading to nonnegative Kullback-Leibler diver- 
gence. 



Generalized nonextensive entropy (j21[) is now defined 
by taking the expectation (1^^ of information content ([7|) : 



(24) 



5f-°rg ip) ^ Ef-OTg ^ 



k 

Let us now define 



w 



In 2 



and a{q) = 1 — g. 



(25) 



Functions (p{q) and a{q) satisfy conditions from Theorem 
[21 which means that information content from introduc- 
tional example ([5]) belongs to the class determined by 
(PU]). Moreover, if we choose k = 1/ In 2, generalized en- 
tropy (p4l) reduces to 



ohc-org(p)^ 



1 



w 

1=1 



(26) 



1 - 21-9 ' 

which represents the Havrda-Charvat entropy 

IV. NEW AXIOMATIC SYSTEM 

As we noted in introduction, some conditions from 
[T0]'^[T3] are redundant and can be omitted, and some 
of them can be weakened so that [T0]^[T3] still lead to 
information content with form ([7]). 

First, the condition Ii{p) = —khip from [TO] can be 
substituted in ([1]) for g = 1 and we get (p{l) — 0. Accord- 
ingly, condition ip{l) — in [T3] is redundant. Hence, 
we suggest: 

1. Relax the assumption (p{l) — from [T3]. 

Axiom [Tl] requires differentiability of Iq(j>) with re- 
spect to p. This condition is necessary when differential 
equation PU)) is constructed in order to get the form (O . 
However, the functional equation ([Ij can be solved with- 
out using the condition that Iq{p) is differentiable with 
respect to p. If we introduce the transformation 



if.ip) - 1) : 



(27) 



equation ((U becomes Cauchy's functional equation, 
fqiPiP2) = fqipi)fq{p2), which has unique continuous 
solution [l| 



fq{p) ^ P'^'-'K 



(28) 



where a{q) is arbitrary real function of q. By substitut- 
ing (pS)) in (l?7l) . we obtain ([7]). In this way, the solution 
is obtained only using the assumption that Iq{p) is con- 
tinuous with respect to p. Therefore, we suggest: 
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2. In [Tl], replace the assumption "Iq{p) is difFerentiable 
with respect to p" with ^^Iq{p) is continuous with 
respect to p" . 

In Suyari's proof the assumption about differentiabil- 
ity of ip{q) and the condition lim ^^^^ 7^ from [T3] are 

used when L 'Hospital's rule is applied for taking the limit 
of (|13p. However, it can be done in an elementary man- 
ner by use of continuity and equality lim (1 -I- a)~ — e, 
a— >-o 

as we did in (I16p . Therefore, we make the following sug- 
gestions: 



3. Relax the assumption lim 

q^l 



dq 



^ from [T3] 



Axioms [Tl] and [T3] require that Iq{p) and ip{q) be 
differentiable with respect to q. These conditions are 
used only to show that a{q) is differentiable as stated 
in property (a); and differentiability of a(q) is then used 
only to conclude that a{q) is continuous, which, in turn, 
is used to prove property (b). Therefore, we make the 
following suggestion: 

4. Relax the assumption about differentiability of Iq{p) 
and ^p{q) with respect to q, by supposing only that 
Iq{p) and ^p{q) are continuous with respect to q. 

Note that if these assumptions are accepted, the state- 
ment "a(q) is differentiable" from property (a) should be 
changed to "a(g) is continuous" . 

The discussion led us to the following modification of 
Theorem [H 

Theorem 2 Let Iq (p) be a function of two variables q G 
R+ and p G (0, 1], which satisfies the following axioms: 

[TO] h (p) = -k\np,k^O 



[Tl] Iq is continuous with respect to p G (0, 1] and q € 



[T2] Iq (p) is convex with respect to p £ (0, 1] for any 
fixed q e R+, 

[T3] there exists a function (p : R R such that 

IqiPlP2) _ IqjPl) ^ Iq{P2) ^ ^„ Iq{Pl) /g (P2 ) ^29) 



for any pi,p2 e (0, 1], ip{q) ^ Q iov q ^ I and ip{q) 
is continuous. 



Then, 



(P) = — TT 



(9) 



1 



(30) 



where A: is a positive constant and 
(a) a (q) is continuous with respect to any q £ R''", and 



(b) it holds that 



a{q) e 



(-00, 0] for (p{q) > 
[0, 1] for ip{q) < 0. 



(31) 



(32) 



Acknowledgments 

This research was supported by the Ministry of Sci- 
ence and Technological Development, Republic of Serbia, 
Grant No. III44006 



[1] J. Aczel. Lectures on Functional Equations and Their Ap- 
plications. Dover Books on Mathematics. Dover Publica- 
tions, 2006. 

[2] Jan Havrda, Frantiek Charvat, Jan Havrda, and Frantisek 
Charvt. Quantification method of classification processes: 
Concept of structural a-entropy. Kybernetika, 1967. 

[3] Hiroki Suyari. Nonextensive entropies derived from form 
invariance of pseudoadditivity. Phys. Rev. E, 65:066118, 
Jun 2002. 



[4] Andrew J. Viterbi and James K. Omura. Principles of 
Digital Communication and Coding. McGraw-Hill, Inc., 
New York, NY, USA, 1st edition, 1979. 

[5] At this point, Suyari implicitly makes assumption that 
/3(g) = P and C{q) — C are constant functions. However, 
it can be easily shown that partial differential equation 
(|10[l holds for nonconstant functions, too. 



